What is the percent increase in composite score from first baseline to second baseline administration?

To calculate the percent increase from first to second baseline test administrations, the dataset was manipulated in the following ways to isolate individuals who received two baseline test administrations:

  1. The test_type variable was filtered to only include valid baseline test administrations.

  2. Individuals who completed two baseline tests were identified and all other individuals were removed.

  3. The scores of the individuals’ five composite scores from both baselines were spread across the data set to appear on one row per individual.

  4. Individual data sets for the five composite scores were created to calculate the difference in baseline 2 to baseline 1 administration.

  5. Individuals who did not score higher on the second baseline administration were removed from the individual composite score data sets.

  6. The five composite score data sets were joined together to create a new data frame of individuals who achieved a positve gain on at least one composite score on the second baseline test administration.

  7. This combined data frame was filtered through to identify individuals who achieved a higher score on all five composite tests on the second baseline administration.

18,739 individuals completed two baseline assessments. 18,438 individuals (98.39%) achieved a higher score on at least one out of five composite scores on the second baseline assessment. 1,319 individuals (7.04%) achieved a higher score on all five composite scores on the second baseline assessment.

Five composite scores:

1. Verbal Memory Composite Score

2. Visual Memory Composite Score

3. Impulse Control Composite Score

4. Reaction Time Composite Score

5. Visual Motor Composite Score

Verbal Memory Composite Score - Baseline 2 Composite Score Increase Only

10,441 individuals (55.72%) increased their verbal memory composite score on the second baseline test administration.

Baseline 1 Summary

The average Baseline 1 score was observed to be 79 points with a standard deviation of 9.32. The minimum score was observed to be 42, and the maximum score was observed to be 99.

Baseline 1 Histogram

Baseline 2 Summary

The average Baseline 2 score was observed to be 88.76 points with a standard deviation of 8.12. The minimum score was observed to be 54, and the maximum score was observed to be 100.

Baseline 2 Histogram

Score Increase Summary

The average point increase from baseline 1 to baseline 2 was observed to be 9.76 points with a standard deviation of 6.94 points. The mininum point increase was observed to be 1, while the maximum point increase was observed to be 44.

Score Increase Histogram

Percent Increase Summary

The average percent increase from baseline 1 to baseline 2 was observed to be a 13.14% increase with a standard deviation of a 10.71% increase.

Percent Increase Density Plot

Verbal Memory Composite Score - Increase on all Five Composite Scores

This section summarizes the verbal memory composite score for the 1,319 individuals who achieved a higher score on all five composite scores of the second baseline test administration.

Baseline 1 Summary

The average Baseline 1 score was observed to be 79.24 points with a standard deviation of 9.06. The minimum score was observed to be 47, and the maximum score was observed to be 99.

Baseline 1 Histogram

Baseline 2 Summary

The average Baseline 2 score was observed to be 88.61 points with a standard deviation of 7.85. The minimum score was observed to be 61, and the maximum score was observed to be 100.

Baseline 2 Histogram

Score Increase Summary

The average point increase from baseline 1 to baseline 2 was observed to be 9.37 points with a standard deviation of 6.76 points. The mininum point increase was observed to be 1, while the maximum point increase was observed to be 44.

Score Increase Histogram

Percent Increase Summary

The average percent increase from baseline 1 to baseline 2 was observed to be a 12.57% increase with a standard deviation of a 10.39% increase.

Percent Increase Density Plot

Verbal Memory Composite Score Raw Data

The data set below contains the raw data for all individuals who achieved a higher Verbal Memory Composite Score on the second baseline test administration.

Verbal Memory Paired T-Test Results

A paired T-test was used to compare the mean verbal memory composite scores of all 18,739 individuals who completed two baseline assessments. On average, individuals scored significantly higher on the second baseline test administration (M = 84.74) than the first baseline test administration (M = 82.63), t(18737) = -26.327, p < .01.

Boxplot

T-Test Results

## 
##  Paired t-test
## 
## data:  mem_verbal_1 and mem_verbal_2
## t = -26.327, df = 18737, p-value < 2.2e-16
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
##  -2.262784 -1.949192
## sample estimates:
## mean of the differences 
##               -2.105988

Baseline 1 Total Descriptive Statistics

Baseline 1 Total Score Histogram

Baseline 2 Total Descriptive Statistics

Baseline 2 Total Score Histogram

Visual Memory Composite Score - Baseline 2 Composite Score Increase Only

11,137 individuals (59.43%) increased their visual memory composite score on the second baseline test administration.

Baseline 1 Summary

The average Baseline 1 score was observed to be 68.33 points with a standard deviation of 12.13. The minimum score was observed to be 22, and the maximum score was observed to be 99.

Baseline 1 Histogram

Baseline 2 Summary

The average Baseline 2 score was observed to be 80.44 points with a standard deviation of 10.71. The minimum score was observed to be 38, and the maximum score was observed to be 100.

Baseline 2 Histogram

Score Increase Summary

The average point increase from baseline 1 to baseline 2 was observed to be 12.1 points with a standard deviation of 8.58 points. The mininum point increase was observed to be 1, while the maximum point increase was observed to be 53.

Score Increase Histogram

Percent Increase Summary

The average percent increase from baseline 1 to baseline 2 was observed to be a 19.74% increase with a standard deviation of a 17.64% increase.

Percent Increase Density Plot

Visual Memory Composite Score - Increase on all Five Composite Scores

This section summarizes the visual memory composite score for the 1,319 individuals who achieved a higher score on all five composite scores of the second baseline test administration.

Baseline 1 Summary

The average Baseline 1 score was observed to be 68.61 points with a standard deviation of 11.81. The minimum score was observed to be 22, and the maximum score was observed to be 95.

Baseline 1 Histogram

Baseline 2 Summary

The average Baseline 2 score was observed to be 81.07 points with a standard deviation of 10.56. The minimum score was observed to be 44, and the maximum score was observed to be 100.

Baseline 2 Histogram

Score Increase Summary

The average point increase from baseline 1 to baseline 2 was observed to be 12.46 points with a standard deviation of 8.7 points. The mininum point increase was observed to be 1, while the maximum point increase was observed to be 44.

Score Increase Histogram

Percent Increase Summary

The average percent increase from baseline 1 to baseline 2 was observed to be a 20.12% increase with a standard deviation of a 17.6% increase.

Percent Increase Density Plot

Visual Memory Composite Score Raw Data

The data set below contains the raw data for all individuals who achieved a higher Visual Memory Composite Score on the second baseline test administration.

Visual Memory Paired T-Test Results

A paired T-test was used to compare the mean visual memory composite scores of all 18,739 individuals who completed two baseline assessments. On average, individuals scored significantly higher on the second baseline test administration (M = 76.14) than the first baseline test administration (M = 72.5), t(18738) = -38.047, p < .01.

Boxplot

T-Test Results

## 
##  Paired t-test
## 
## data:  mem_visual_1 and mem_visual_2
## t = -38.047, df = 18738, p-value < 2.2e-16
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
##  -3.826403 -3.451467
## sample estimates:
## mean of the differences 
##               -3.638935

Baseline 1 Total Descriptive Statistics

Baseline 1 Total Score Histogram

Baseline 2 Total Descriptive Statistics

Baseline 2 Total Score Histogram

Impulse Control Composite Score - Baseline 2 Composite Score Increase Only

7,900 individuals (42.16%) increased their impulse control composite score on the second baseline test administration.

Baseline 1 Summary

The average Baseline 1 score was observed to be 5.25 points with a standard deviation of 3.69. The minimum score was observed to be 0, and the maximum score was observed to be 28.

Baseline 1 Histogram

Baseline 2 Summary

The average Baseline 2 score was observed to be 9.41 points with a standard deviation of 5.27. The minimum score was observed to be 1, and the maximum score was observed to be 30.

Baseline 2 Histogram

Score Increase Summary

The average point increase from baseline 1 to baseline 2 was observed to be 4.15 points with a standard deviation of 3.43 points. The mininum point increase was observed to be 1, while the maximum point increase was observed to be 26.

Score Increase Histogram

Percent Increase Summary

To compute the percent increase of the impulse control composite score, 255 individuals were removed from the data set becuase they obtained a 0 score on the first baseline test administration, which prevents the ability to complete a percent increase calculation. Individuals with a score of 1 or greater on the first baseline test administration were included for this calculation, which slightly skews the data. The average percent increase from baseline 1 to baseline 2 was observed to be a 119.13% increase with a standard deviation of 146.98% increase.

Percent Increase Density Plot

Impulse Control Composite Score - Increase on all Five Composite Scores

This section summarizes the impulse control composite score for the 1,319 individuals who achieved a higher score on all five composite scores of the second baseline test administration.

Baseline 1 Summary

The average Baseline 1 score was observed to be 5.17 points with a standard deviation of 3.55. The minimum score was observed to be 0, and the maximum score was observed to be 25.

Baseline 1 Histogram

Baseline 2 Summary

The average Baseline 2 score was observed to be 9.16 points with a standard deviation of 4.92. The minimum score was observed to be 1, and the maximum score was observed to be 30.

Baseline 2 Histogram

Score Increase Summary

The average point increase from baseline 1 to baseline 2 was observed to be 3.99 points with a standard deviation of 3.19 points. The mininum point increase was observed to be 1, while the maximum point increase was observed to be 23.

Score Increase Histogram

Percent Increase Summary

To compute the percent increase of the impulse control composite score, 50 individuals were removed from the data set becuase they obtained a 0 score on the first baseline test administration, which prevents the ability to complete a percent increase calculation. Individuals with a score of 1 or greater on the first baseline test administration were included for this calculation, which slightly skews the data. The average percent increase from baseline 1 to baseline 2 was observed to be a 114.23% increase with a standard deviation of 140.46% increase.

Percent Increase Density Plot

Impulse Control Composite Score Raw Data

The data set below contains the raw data for all individuals who achieved a higher Impulse Control Composite Score on the second baseline test administration.

Impulse Control Paired T-Test Results

A paired T-test was used to compare the impulse control composite scores of all 18,739 individuals who completed two baseline assessments. On average, individuals scored significantly higher on the first baseline test administration (M = 7.41) than the second baseline test administration (M = 6.99), t(18738) = 10.641, p < .001.

Boxplot

T-Test Results

## 
##  Paired t-test
## 
## data:  impulse_control_1 and impulse_control_2
## t = 10.641, df = 18738, p-value < 2.2e-16
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
##  0.3393532 0.4926016
## sample estimates:
## mean of the differences 
##               0.4159774

Baseline 1 Total Descriptive Statistics

Baseline 1 Total Score Histogram

Baseline 2 Total Descriptive Statistics

Baseline 2 Total Score Histogram

Reaction Time Composite Score - Baseline 2 Composite Score Increase Only

11,084 individuals (59.15%) improved their reaction time composite score on the second baseline test administration.

Baseline 1 Summary

The average Baseline 1 score was observed to be 0.67 points with a standard deviation of 0.11. The minimum score (indicating faster reaction time) was observed to be 0.44, and the maximum score (indicating slower reaction time) was observed to be 2.85.

Baseline 1 Histogram

Baseline 2 Summary

The average Baseline 2 score was observed to be 0.59 points with a standard deviation of 0.07. The minimum score was observed to be -0.18, and the maximum score was observed to be 1.03.

Baseline 2 Histogram

Score Increase Summary

The average point decrease (indicating better performance for the reaction time composite test) from baseline 1 to baseline 2 was observed to be 0.08 points with a standard deviation of 0.08 points. The mininum point decrease (indicative of better performance) was observed to be 0.01, while the maximum point decrease was observed to be 2.36.

Score Increase Histogram

Percent Increase Summary

The average percent decrease from baseline 1 to baseline 2 was observed to be a 11.36% increase with a standard deviation of a 8.36% decrease.

Percent Increase Density Plot

Reaction Time Composite Score - Increase on all Five Composite Scores

This section summarizes the reaction time composite score for the 1,319 individuals who achieved a higher score on all five composite scores of the second baseline test administration.

Baseline 1 Summary

The average Baseline 1 score was observed to be 0.67 points with a standard deviation of 0.12. The minimum score was observed to be 0.44 (indicative of faster reaction time), and the maximum score was observed to be 2.42.

Baseline 1 Histogram

Baseline 2 Summary

The average Baseline 2 score was observed to be 0.58 points with a standard deviation of 0.07. The minimum score was observed to be -0.18, and the maximum score was observed to be 0.96.

Baseline 2 Histogram

Score Increase Summary

The average point decrease from baseline 1 to baseline 2 was observed to be 0.09 points with a standard deviation of 0.1 points. The mininum point decrease was observed to be 0.01, while the maximum point decrease was observed to be 1.81.

Score Increase Histogram

Percent Increase Summary

The average percent decrease from baseline 1 to baseline 2 was observed to be a 12.48% decrease with a standard deviation of a 9.44% decrease.

Percent Increase Density Plot

Reaction Time Composite Score Raw Data

The data set below contains the raw data for all individuals who achieved a higher Reaction Time Composite Score on the second baseline test administration.

Reaction Time Paired T-Test Results

A paired T-test was used to compare the reaction time composite scores of all 18,739 individuals who completed two baseline assessments. On average, individuals demonstrated a faster reaction time on the second baseline test administration (M = 0.62) than the first baseline test administration (M = 0.64), t(18737) = 27.658, p < .01.

Boxplot

T-Test Results

## 
##  Paired t-test
## 
## data:  reaction_time_1 and reaction_time_2
## t = 27.658, df = 18737, p-value < 2.2e-16
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
##  0.02063598 0.02378392
## sample estimates:
## mean of the differences 
##              0.02220995

Baseline 1 Total Descriptive Statistics

Baseline 1 Total Score Histogram

Baseline 2 Total Descriptive Statistics

Baseline 2 Total Score Histogram

Visual Motor Composite Score - Baseline 2 Composite Score Increase Only

14,355 individuals (76.60%) increased their visual motor composite score on the second baseline test administration.

Baseline 1 Summary

The average Baseline 1 score was observed to be 33.26 points with a standard deviation of 6.46. The minimum score was observed to be 1.13, and the maximum score was observed to be 52.88.

Baseline 1 Histogram

Baseline 2 Summary

The average Baseline 2 score was observed to be 38.81 points with a standard deviation of 6.3. The minimum score was observed to be 12.05, and the maximum score was observed to be 54.25.

Baseline 2 Histogram

Score Increase Summary

The average point increase from baseline 1 to baseline 2 was observed to be 5.55 points with a standard deviation of 3.97 points. The mininum point increase was observed to be 0.02, while the maximum point increase was observed to be 37.35.

Score Increase Histogram

Percent Increase Summary

The average percent increase from baseline 1 to baseline 2 was observed to be a 18.8% increase with a standard deviation of a 22.17% increase.

Percent Increase Density Plot

Visual Motor Composite Score - Increase on all Five Composite Scores

This section summarizes the reaction time composite score for the 1,319 individuals who achieved a higher score on all five composite scores of the second baseline test administration.

Baseline 1 Summary

The average Baseline 1 score was observed to be 33.18 points with a standard deviation of 6.56. The minimum score was observed to be 1.13, and the maximum score was observed to be 50.8.

Baseline 1 Histogram

Baseline 2 Summary

The average Baseline 2 score was observed to be 39.17 points with a standard deviation of 6.32. The minimum score was observed to be 12.6, and the maximum score was observed to be 53.5.

Baseline 2 Histogram

Score Increase Summary

The average point increase from baseline 1 to baseline 2 was observed to be 5.99 points with a standard deviation of 4 points. The mininum point increase was observed to be 0.02, while the maximum point increase was observed to be 30.

Score Increase Histogram

Percent Increase Summary

The average percent increase from baseline 1 to baseline 2 was observed to be a 20.98% increase with a standard deviation of a 37.46% increase.

Percent Increase Density Plot

Visual Motor Composite Score Raw Data

The data set below contains the raw data for all individuals who achieved a higher Visual Motor Composite Score on the second baseline test administration.

Visual Motor Paired T-Test Results

A paired T-test was used to compare the reaction time composite scores of all 18,739 individuals who completed two baseline assessments. On average, individuals scored significantly higher on the second baseline test administration (M = 37.64) than the first baseline test administration (M = 34.15), t(18738) = -89.275, p < .01.

Boxplot

T-Test Results

## 
##  Paired t-test
## 
## data:  visual_motor_1 and visual_motor_2
## t = -89.275, df = 18738, p-value < 2.2e-16
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
##  -3.569844 -3.416455
## sample estimates:
## mean of the differences 
##                -3.49315

Baseline 1 Total Descriptive Statistics

Baseline 1 Total Score Histogram

Baseline 2 Total Descriptive Statistics

Baseline 2 Total Score Histogram

Paired T-Test Summary

The results of the paired t-tests across all five composite scores for comparison of baseline performance identified that individuals, on average, improved their score on the second baseline test administration of the verbal memory, visual memory, reaction time and visual motor composites. Conversely, individuals were identified to score, on average, significantly higher on the first baseline test administration of the impulse control composite.

Is there a significant difference in baseline test performance in individuals who completed multiple (more than 2) baseline test administrations?

Total Number of Individuals by Number of Baseline Test Administrations Taken

The t-tests in the seciton above compare the performance between individuals who completed two baseline assessments. The number of individuals who completed three, four, and five baseline assessments is large enough to compare differences in performance through the use of a repeated measure analysis of variance (ANOVA).

Table

Plot

Verbal Memory

Three Baseline Tests

For individuals who completed three baseline tests, performance on the verbal memory composite score was statistically significantly different, F(1.99, 5,822.57) = 236.46, p < .0001, generalized eta squared = 0.03.

Post-hoc analyses with a Bonferroni adjustment revelated that all pairwise comparisons, between baseline test administrations, were statistically significantly different (p < .05). Individuals were identified to achieve the highest verbal memory score on the third baseline assessment (M = 86.52) compared to the second (M = 84.58) and first (M = 82.28) baseline administrations.

Boxplot

Outliers

There are no extreme outliers.

Normality Assumption

From the plot, normality is assumed.

ANOVA Computation

## ANOVA Table (type III tests)
## 
##            Effect  DFn     DFd       F        p p<.05  ges
## 1 baseline_number 1.99 5822.57 223.461 1.06e-93     * 0.03

Post-hoc Tests

## # A tibble: 3 x 10
##   .y.   group1 group2    n1    n2 statistic    df        p    p.adj p.adj.signif
## * <chr> <chr>  <chr>  <int> <int>     <dbl> <dbl>    <dbl>    <dbl> <chr>       
## 1 score verba… verba…  2930  2930     -11.3  2929 3.47e-29 1.04e-28 ****        
## 2 score verba… verba…  2930  2930     -20.5  2929 1.16e-87 3.48e-87 ****        
## 3 score verba… verba…  2930  2930     -10.1  2929 1.89e-23 5.67e-23 ****

Result Visualization

Baseline 1 Summary

Baseline 1 Histogram

Baseline 2 Summary

Baseline 2 Histogram

Baseline 3 Summary

Baseline 3 Histogram